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STUDY  PROJECT  GOALS: 

1*  To  review  and  evaluate  procedures  utilized  in  the  procurement  of 
sonobuoys,  with  particular  enplasis  on  Test  and  Evaluation. 

2.  To  put  into  prospective  those  aspects  of  weapon  systems  acquisition 
that  apply  to  non  major  weapon  systems. 


STUDY  REPORT  ABSTRACT: 

This  study  focuses  on  the  historical  growth  and  present  application  of 
procurement  practices  for  the  acquisition  of  sonobuoys  for  the  U.S.  Uavy. 
An  historical  approach  was  utilized  to  develop  the  setting  for  present 
conditions,  to  illuminate  the  effect  of  technology  growth  on  the  process. 
This  is  especially  noteworthy  in  the  I960*  s.  Particular  emphasis  was 
devoted  to  the  area  of  test  and  evaluation.  Testing  of  these  expendible 
units  is  devoted  primarily  to  the  area  of  production  units  si>ce  the  nature 
of  the  sonobuoy  production  cycle  includes  the  production  of  hundreds  of 
thousands  of  units  following  the  initial  production  go  ahead.  Rationale 
is  provided  for  the  present  procurement  concept,  Firm  Fixed  Price  contract 
type  and  specific  reviews,  audits  and  tests.  Recommendations  as  to  areas 
warranting  further  study  are  listed. 
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The  purpose  of  this  study  was  to  provide  information  on  "the 
historical  and  present  approach  to  the  total  acquisition  cycle  of 
sonobuoys  for  t e U.S.  New.  A sonobuoy,  which  is  an  expendable 
sensor  used  by  aircraft  in  the  prosecution  of  anti-submarine  warfare, 
is  a relatively  complex,  densly  packaged  and  rugged  piece  of  avionics 
equipment.  The  sonobuoy  is  used  in  conjunction  with  airborne  pro- 
cessing equipment  to  convert  underwater  submarine  sound  signals  into 
discemable  information  which  identify  and  locate  the  target. 

Sonobuoy  production  has  grown  significantly  from  its  initial 
in-house  efforts  of  World  War  II.  All  production  is  now  accomplished 
by  contracting  firms,  as  is  the  majority  of  research  and  development. 

As  the  technology  increased,  particularly  in  the  1960's,  so  too 
did  tie  testing  requirements.  New,  elaborate  testing  facilities  have 
been  designed  and  established  in  Maine  ana  the  Virgin  Islands.  Ex- 
tensive testing,  particularly  on  production  end  items  is  accomplished 
to  ensure  a-reement  with  snecifications  and  to  verify  reliability. 

Although  f.  e requirements  for  :or.o  uoy  functional  characteristics 
are  normally  developed  in  response  to  processor  requirements,  provisions 
are  provided  for  operational  requirements  from  fleet  users.  These 
requirements  and  changes  however,  are  normally  minor  in  that  the  end 
product  must  be  fully  compatible  with  existing  processors.  In  general, 
when  functional  changes  to  existin™  processors  or  new  processing 
eigiipmar.t  is  specified,  they  are  designed  such  that  sonobuoys  presently 
existing  in  the  fleet  inventory  remain  compatible  and  dc  not  become 
immediately  obsolete,  thus  minimizing  logistic  and  operational  costs. 

Several  areas  for  further  research  ere  detailed  in  this  study, 
namely:  operationr.l  requirements,  failure  data  collection,  stowage  and 
handling,  mobilization  bese  requirements,  sample  and  lot  size  determination, 
and  classification  of  failure:;  from  an  operational  viewpoint. 
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SECTION  I 
BACKGROUND 


"Where  once  the  submarine  was  a weapon  employed  solely  against 
other  Naval  forces,  in  recent  times  this  system  has  employed  both 
strategic  and  tactical  missle  systems  capable  of  striking  deep  within  en 
enemy's  lend  masses."  And  as  the  full  potential  of  the  submarines' 
capabilities  are  being  realized,  so  too  hats  +he  importance  grown,  in 
the  efforts  to  neutralize  this  threat. ^ 

Anti-submarine  warfare  ( ASW ) may  take  on  many  forms,  from  the  static 
to  the  highly  dynamic.  Where  once  underwater  obsticles,  nines  and  tor- 
pedoes could  lie  and  wait  for  the  transiting  enemy  in  relatively  re- 
stricted waters,  enemy  submarines  are  now  found  primarily  in  the  unre- 
stricted open  seas. 

Perhaps  the  most  dynamic  and  most  time-sensitive  mode  of  ASV/  is  the 
utilization  of  the  aircraft  as  the  primary  element  of  detection,  class- 
ification, tracking  end  destruction  of  the  enemy  submarine.  The  only 
ASV/  system  that  has  a definite  speed  advantage  over  the  submerged 
submarine  is  the  aircraft.  Additionally,  the  aircraft  has  the  added 
advantage  of  b‘ing  covert  and  undetectable  to  the  submarine  since  the 
two  operate  in  different  mediums. 

For  all  practical  purposes  the  submarines  cannot  detect  or  identify 
a persuing  aircraft.  It's  only  defense  against  the  aircraft  lies  in  its 
attempt  to  remain  undetected. 

To  bridge  the  barrier  between  the  sea  and  the  air  in  favor  of  the 
aircraft  is  the  sonobuoy  system,  which  give::  the  aircraft  the  ability  to 
acoustically  listen  to  underwater  sounds.  These  scunds  r.:e  timed, 

NOTE:  This  notation  will  be  used  throughout  t-e  report  for  sources  of 
quotations  and  major  references.  References  are  found  in  the  Section 
titled  NOTES, 
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analyzed  and  geographically  plotted  to  initially  detect  and  classify  and 
eventually  to  position  and  track  the  underwater  target.  Although  the  main 
<*lem  ts  of  this  elecro-acoustic  system  remain  in  the  aircraft,  the  focal 
point  of  the  system,  the  device  that  enables  the  bridging  of  the  sea/air 
interface,  is  the  expendable  sonobuoy  itself. 

Although  sonobuoys  were  invented  and  used  during  World  War  II,  they 

emerged  from  this  war  as  an  unproven  component,  for  they  did  not  aid  in 

2 

the  destruction  of  a single  ship.  And  since  actual  submarine  warfare  has 
not  occured  since  that  war  t'.e  sonobuoy,  although  in  continual  use  today, 
has  no  wartime  kill  record  to  enhance  its  stature. 

The  technology  of  electronics  and  underwater  acoustics  have  advanced 

significantly  during  the  past  three  decades  and  the  sonobuoys  of  today 
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resemble  those  used  during  World  War  II  in  shape  only.  A typical  present 
day  sonobuoy  is  depicted  in  Pig.  1. 

The  simple  sonobuoy  consists  of  a hydrophone,  a signal  converter  and 
amplifier,  a VHP  radio  transmitter,  retarding  devices  to  permit  non- 
destructive aircraft  launch  and  water  entry,  a battery  and  flotation 
equipment.^  Sonobuoys  may  be  classified  by  mode,  (active  or  passive), 
size,  function,  frequency  spectrum,  activation  tine  or  depth  of  hydrophone; 
for  purposes  of  this  discussion,  however,  no  distinction  will  be  made  as 
to  type  or  classification  since  it  is  not  germane  to  the  area  in  question  ie., 
the  term  sonobuoy  will  refer  to  the  device  in  general,  regardless  of 
characteristics. 

Immediately  following  aircraft  launch,  the  rotochute  assembly 
opens  (see  Pig.  l)  to  allow  the  sonobuoy  to  autorotate  slowly  end  reduce 
water  impact.  Upon  water  entry,  the  rotochute  is  jettisoned,  the  trans- 
mitting antenna  springs  out,  the  base  plate  falls  free  and  the  hydrophone 
deploys,  an  orange-red  dye  is  released  and  the  salt  water  battery  is 
activated.  !.!ost  sonobuoys  have  pre-selected  hydrophone  depths  and  activation 
life  settings.  After  the  activation  life  has  expired,  a water  soluable 
plug  scuttles  the  entire  d-vioe.  Some  sonobuoys  hrve  the  added  feature  of 
remote  command  scuttlirg  from  the  aircraft.  The  sonobuoy  then  is  a paradox; 
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for  even  though  it  is  the  focus  for  the  confrontation  of  two  multi- 

million  dollar  weapon  systems,  and  is  the  key  to  success  of  these  two 

competing  technologies,  it  is  a relatively  inexpensive  and  exoendable 

— 

device. 


P.OROGHPTS- 


1TT3TNA 


i i 


RETAIKH.'G 
CAP  — 

BASE  PLATE " 


UJ 


irfBRQHicn-: 


In  present  day  sonobuoy  devlopnent , the  re- uirenent  for  a specific 
sonobuoy  characteristic  ia  normally  a fallout  of  other  development  require- 
ments within  both  Navy  end  civilian  laboratories.  Because  the  sonobuoy  is 
not  a fully  self  contained  system,  but  rather  is  used  in  conjunction  with 
the  varied  processors  located  in  the  aircraft,  it  is  normally  the  design 
parameter  of  the  acoustic  processing  equipment  that  determines  the  func- 
tional characteristic  requirements  of  sonobuoys.  The  development  of  the 
AQA-7  acoustic  processing  equipment  for  use  in  the  P-3  aircraft  necessitated 
the  requirement  for  two  specific  sonobuoy  types;  namely  the  SSQ-53 
(Directional,  Passive)  buoy  and  the  SSQ-50  (Command  Activated,  Active)  buoy.1 

In  general  each  update  of  acoustic  processor  retains  the  capability 
of  utilizing  previously  acquired  sonob-  oys,  to  eliminate  operational  -und 
logistic  problems  associated  with  mis-match  of  sonobuoy  and  processor,  as 
well  as  to  reduce  costs.  This  philosophy  is  continuing  into  the  systems 
now  under  development;  the  AQA-9  processor  and  3SQ-62  (Command  Activated, 
Active  and/or  Passive)  sonobuoy. 

New  or  revised  requirements  are  also  necessitated  by  the  introduction 

of  new  aircraft  into  the  inventory  as  well  as  by  operational  necessities. 

The  current  Product  Improvement  Program  for  sonobuoys  is  a re-engineering 

program  designed  to  upgrade  certain  sonobuoys  to  better  match  the  increased 

operating  envelopes  (altitude  and  speed)  of  newer  aircraft.  This  program 

will  additionally  improve  handling  and  storage  characteristics  as  well  as 

7 

improved  operational  capabilities  and  reliabilities. 

Fleet  requirements  into  the  sonobuoy  acquisition  process  generally 
take  the  orm  of  change  re cue ■ ts  to  existing  equipment,  such  as  hydrophone 
depth  and  visual  aids  for  location,.  However,  the  policy  of  the  Chief  of 
Naval  Operations  remains,  that  any  fleet  activity  or  Navy  Command  may 

Q 

submit  an  op>:  'ational  requirement  to  the-  Force  and  I’iasion  sponsors. 

Those  that  ere  cc nsidered  valid  and  worthy  of  pursuing  arc  then  transmitted 


to  the  Chief  of  Naval  Material  for  development  and/or  acquisition*  In 
addition  to  U.c.  Navy  requirements,  all  operational  requirements  and 
specifications  must  natch  t'.iose  delineated  by  NATO  Committee  Sonobuoy 
Standards  (TRIPARTITE).9 


SECTION  III 
PHCCUHZI'LnT 


A,  Background 


The  initial  World  War  IT  sonobuoys  used  by  th*  U.S.  Navy  were 
fully  developed  and  produced  by  the  Underwater  Sound  Labratory  at  New  London, 
Conn.^°  Following  the  war,  personnel  reductions,  changing  government 
procurement  policies  and  increasing  technology  requirements  necessitated 
the  gradual  introduction  of  industry  into  the  research  and  development  of 
sonobuoys.  During  this  post  World  War  II  era,  the  then  Bureau  of  Aero- 
nautics established  a comprehensive  3onobuoy  5&D  capability  at  uhe  Naval 
Air  Development  Center  (NADC),  Warminster,  Fenr.a.  (This  expensive  capability 
still  remains  at  NADC). 

During  the  Korean  War,  en  immediate  need  was  recognized  to 
quickly  expand  the  developr.ent  anc  production  of  reliable  end  effective 
sonobuoys.  It  was  at  t:  is  time  that  commercial  industrial  firms  became 
paramount.  The  transfer  of  this  technology  base  was  effectively  coordinated 
by  NADC.  The  Naval  Air  Development  Center  however,  maintained  it's  cap- 
ability in  concept  feasibility.  Soon  a rather  road  base  of  development 
and  products  a technology,  ana  its  accompanying  large  monetary  investments, 
existed  i:  the  civilian  industrial  complex  '.here  it  still  remains. ^ The 
most  noticalbe  producers  of  sonob  oys  for  the  Navy  today  axe;  (alphabetically) 
Hermes  Ltd.  of  Canada,  I'agnavox,  Sanders  Associates  rra  Sn^tPr.  Electronics, 

B.  Design  Disclosure 

During  the  1950's  ana  I960' c the  Design  Disclosure  Package  Concent 
for  acquisition,  which  was  originated  by  the  Naval  Ordnance  Labratory  for 
ordnance  procurement,  was  attempted  in  the  procurement  of  sonobuoys. 

The  Design  Disclosure  Package  concept  permits  c mpiete  stand- 
ardization, unlimited  production  base,  absolute  design  control  including 
Quality  Assurance  and  eliminates  redundant  development  efforts  md  costs. 

This  concepb  however,  hss  drawbacks.  It  forces  responsibility  for  performance 
onto  the  Navy  end  e way  from  the  producer,  eliminates  competition  generated 
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by  contractor  value  engineering,  requires  more  contracting  changes  and 


necessitates  a subatantial  increase  in  technically  qualified  government 
12 

personnel*  The  two  sonobuoy  procurement  attempts  utilizing  the  Design 


Disclosure  Package  (S3Q-28,  and  SSQ-42)  resulted  in  failure  due  to  manpower 

13 

shortages  and  technical  problems. 


C.  Performance  Specification 


The  most  utulized  acquisition  approach  used  for  sonobuoy 
acquisition  is  Performance  Specification,  in  which  feasibility  investigation 
is  performed  by  Navy  laboratories  while  the  major  research  end  development 
and  all  production  is  performed  by  industry.  The  Performance  Specification 
concept  encourages  lower  costs  by  promoting  competition,  requires  fewer 
technically  qualified  government  employees,  ensures  acceptance  of  performance 
responsibilities  by  the  contractors,  provides  fewer  contractural  problems 
and  has  a more  rapid  acquisition  progress.  The  primary  disadvantage  of  this 
concept,  that  it  provides  no  standardized  end  product,  is  not  considered 


significant  since  the  sonobuoy,  by  design,  is  a ncn-repairable , non-main- 
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tainable,  non-reuseable  device.  Commonality  of  ports  and  components  is 
not  critical;  what  is  critical  is  the  attainment  of  the  functional  and 
physical  specifications.  The  acceptance  of  the  Pertorr.ance  Specification 
concept  for  sonobuoy  acquisition  has  the  general  consensus  of  both  industry 
and  military  personnel  and  wm  no  doubt  continue  as  the  major  approach 
for  the  forseeablc  future. 


D.  Negotiation. 


Although  Formal  Advertising  is  the  desired  method  for 
government  procurement,  procurement  may  be  effected  by  negotiation  if 


one  of  17  specific  exemptions  apply.  These  exemptions  are  detailed  in 

15 

Section  III  of  the  Armed  Services  Procurement  Regulation.  Production 


sonebuoys  ere  negotiated  under  exemption  16  of  this  Regulation  which  d'-als 
with  Industrial  Nobilization.  To  hp  more  specific,  the  Navy  Class  Deter- 


mination and  Findings  which  provides  current  justification,  is  quoted 

, .16 


in  oartj' 


nl...  Sonobuoys  are  extremely  complex,  requiring 
lengthy  tooling,  and  uroduction  preparations  one  their 


production  delay  or  disruption  would  be  very  detrimental 
to  the  Department  of  Defense  posture...  It  is  essential 
to  plan,  in  the  event  of  conflict  short  of  general  war, 
for  dispersed  and  alternate  sources  of  production  to  reduce 
vulnerability  and  to  maximize  their  chances  for  survival 
in  the  initial  stages  of  a national  emergency.  Such 
mobilization  planning  must  retain  and  foster  a production 
base  for  an  orderly  transition  from  peacetime  to  wartime 
conditions. ... 

"5.  Use  of  formal  advertising  for  the  procurement 
described  above  is  not  feasible  or  practicable  because 
the  method  might  require  the  award  of  a contract  to  a low 
bidder  who  is  not  a planned  producer  under  mobilisation 
base  planning,  thereby  preventing  the  award  of  single  or 
multiple  contracts  to  sources  having  the  requisite  mobil- 
ization base  capabilities  to  the  detriment  of  the  national 
defense  and  mobilization.'.." 

E.  Mobilization  Base 

In  general,  the  mobilization  requirements  can  be  separated 
into  two  parts ; inventory  requirements  and  monthly  consumption  rates. 
Inventory  requirements  are  predicated  on  emergency  useage  for  specified 
periods.  The  monthly  mobilization  consumption,  while  based  upon  wartime 
consumption  rates,  does  not  delineate  a specific  tine  to  deplete  stockpiles 
but  requires  a plan  to  expand  monthly  production  to  sustain  wartime  usage. 
The  quantities  of  sonobuoys,  for  both  catagories  are  specified  by  the 
Chief  of  Naval  Operations.  Several  problems  arise  from  this  concept: 
Sonobroys,  unlike  most  other  war  materials,  will  quite  probably  experience 
a severe  increase  in  usage  rate  prior  to  a declaration  of  war.  The  quantity 
specified  as  inventor;;  requirements  must  therefore  be  sufficiently  large 
to  permit  sufficient  production  build-up,  and  world  wide  delivery.  Planning 
in  this  area  must  be  accurate  and  reviewed  constantly,  for  the  useage  rate 
of  sonobuoys  is  dependant  on  such  changing  factors  as;  target  threat 
(both  quantity  and  type),  environmental  water  conditions  which  may  or  may 
not  be  seasonal,  geography,  specific  aircraft  mission,  tactics  employed 
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and  whether  the  aircraft  is  operating  independently  or  in  concert  with 
other  friendly  forces.  It  is  therefore  critical  that  these  CNO  directed 
quantities  be  related  to  the  total  mobilization  capacity  of  all  producers. 

It  is  also  ample  justification  for  utilizing  exemption  16  to  the  ASPR 
for  the  procurement  of  sonobuoys. 

P.  Qualification  of  Additional  Producers 

At  present,  there  are  two  methods  for  the  qualification  of 
additional  producers  of  sonobuoys.  Any  responsible  firm  may  complete 
a successful  research  and  development  effort  through  Operational  Test  and 
Evaluation.  This  may  result  either  from  a solicited  or  unsolicited  design 
proposal.  Additionally,  the  Navy  will  furnish  to  any  interested  manufacturer, 
upon  request,  a specification,  model  and  drawings  for  a particular  model 
8onobuoy.  This  firm  may  if  they  desire,  and  at  their  own  expense,  build 
and  submit  50  sonobuoys  for  testing.  If  these  tests  results  are  favorable, 
the  firm  will  be  added  to  the  list  of  companies  solicited  in  future 
procurements.^ 


6,  Contract  Type 

Because  of  the  relatively  low  technical  and  cost  risks,  as 
well  as  the  high  volume  of  production,  FI  1?K  FIXED  PRICE  (PFP) 
contracting  is  utilized  for  sonobuoy  procurement.  This  contract  type, 
which  permits  maximum  profitability  for  the  contractor,  also  eases  the 
administration  and  control  requirements  for  the  government.  The  use  of 
FFP  type  contracts  is  also  in  agreement  with  the  use  of  the  performance 
specifications  concept  previously  described. 

Normally  sonobuoy  contracts  call  for  a specific  number  of 
end  items,  by  type,  for  each  production  run.  Each  production  run  is 
broken  down  into  lots,  nomolly  of  800,  for  identification,  testing  and 
acceptance.  Extensive  quality  assurance  and  testing  of  selected  end 
items  is  then  perfomed.  This  will  be  discussed  in  greater  detail  in  a 
succeeding  parapraph. 

K.  Configuration  honor er.er.t 

As  with  root  electro  ic  equipments,  nuaero'  s :eferences, 
specifications  nc  standards  must  be  utilized  to  fully  vnd  explicitly 
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describe  the  product  -'or  contracting  purposes.  Additionally  these 
descriptors  ensure  that  technical  performance  of  the  flert  requirements 
are  satisfied.  The  naval  Air  Development  Center,  under  the  direction 
of  the  Naval  Air  Systems  Command,  procuced  an  Aeronautical  Requirement  (AS) 


document  to  ensure  sound  configuration  management  of  sonobuoys  and  sonobuoy 
18 

packaging.  This  document,  which  is  concise,  readable  ana  easily  used  is 


applicable  to  every  contract  for  the  procurement  of  development  and  pro- 
duction sonobuoys.  It  ensures  that  all  characteristics  of  sonobuoys,  both 
functional  and  physical,  are  identified  and  documented;  it  insures  complete 
control  of  approved  changes  to  these  characteristics;  and  finally  it  records 
and  reports  to  all  concerned,  the  processing  and  implementation  status  of 
all  changes. 


I.  Baselines. 


To  adequately  describe  the  physical  and  functional  characteristics 
for  the  production  of  sonobuoys,  tv/o  specific  baselines  have  been  established. 
The  first  baseline  (ALLOC AT  .D)  is  the  exact  configuration  of  the  initial 
units.  These  are  verified  by  a physical  Configuration  Audit.  This  audit, 
which  compares  the  end  item  to  the  required  drawings  and  specification  as 
well  as  to  the  particulars  of  the  manufacturing  processes  employed,  is 
normally  accomplished  at  the  contractors  facility.  In  general,  the  oDjective 
of  this  procedure  is  to  ensure  that  the  first  article  is  in  conformance 
with  the  requirements  previously  stated,  and  to  ensure  reproducability. 

The  second  (PRODUCT)  baseline  represents  items  of  the  fourth 
lot  of  sonobuoys  that  pass  the  testirg  reouirements  without  waiver.  This 
product  baseline  represents  the  standards  egainst  which  all  future  pro- 
duction end  items  will  be  compared.  They  are  also  subjected  to  a physical 
Configuration  Audit.  This  audit  includes  verification  of  fabrication 
processes,  on-line  production  testing,  assemb]y  processing  as  v/ell  as  the 


usual  check  to  standards  and  specifications. 


Following  t e physical  audits,  the  contractor  must  ensure  that  all 


chemges  in  parts  and  material  result  in  an  "equivilant  or  better  then" 

1«- 

policy  for  replacement,  " The  contractor  is  responsible  for  er.suri:  g 


that  this  policy  ia  maintained  with  his  vendors  as  well. 
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Waivers  to  the  above  process  and  ac tiers  nay  be  granted  to 
contractors  for  production  items  v.hich  do  not  meet  specified  requirements 
but  are  never- the-less  considered  to  be  suitable  for  use.  These  waivers, 
are  classified  as  minor,  major  and  critics!!.  The  definitions  of  waivers 
is  further  described  in  MIL-STD-109. 

J.  Funding 

Sonobuoys  ere  sensors  end  therefore  are  an  integral  portion  of 
a weapon  system.  They  ere  not  utilized  as  a weapon  itself  and  cannot  by 
themselves  irflict  damage.  Historically  btwever,  they  have  been  classified 
as  ordnance  and  remain  so  classified  today.  The  funding  of  the  acquisition 
of  sonobuoys  therefore  does  not  follow  the  normal  cycle,  and  sonobuoys 
are  not  funded  out  of  accounts  associated  with  the  procurement  of  werpons 
systems.  Rather,  sonobuoys  are  considered  as  an  expendible  line  item  in 
the  appropriations  eatagory  of  Other  Procurement,  Navy  (0Bf)»  A severe 
limitation  to  this  classification  of  sonobuov  procurement  funds  is  the 
one-year  limit  for  obligation,  whereby  funds  appropriated  for  any  one 
fiscal  year. must  in  fact  be  obligated  during  t at  year.  This  one-year 
cycle  has  been  criticized  as  limiting  the  monies  a contractor  will  spend 
on  plant  modernization  and  technology  improvements  and  therefore  does  not 
enhance  the  reduction  of  unit  costs.  The  ot:  r side  of  this  argument 
however,  notes  the  large  amount  of  visible  competition  among  sonobuoy 
manufacturers.  The  obvious  advantage  of  the  CH  classification  lies  in 
the  relative  ease  of  obtaining  funding  authorization  from  in-service 
sources  instead  of  vising  for  procurement  dollars.  And  in  support  of  the 
"other  procurement"  classification  it  must  be  stressed  that,  while  tech- 
nically not  an  ordnance  item,  it  is  used  as  a support  item  in  a manner  such 
as  fuel  and  ammunition  an'-  shoulc.  be  classified  as  an  operating  expense 
vice  a weapon  system  procurement. 
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SECTION  IV 
TEST  AND  EVAIV.ATION 


A.  Background 

In  the  1940's,  all  production  design  approval,  and  sonobuoy 

acceptance  testing  was  conducted  under  the  cognizance  of  the  Naval  Air 

Development  Center  (lIADC),  Johnsville,  Penna.  During  this  period, 

laboratory  tests  were  performed  by  NADC  and  air  dro;,  tests  were  conducted 

by  Naval  personnel  at  the  Naval  Air  Test  Center,  Patuxent  River,  Md. 

Bench  testing  of  the  production  units  normally  occured  at  the  factory, 

by  contractor  personnel  who  were  monitored  by  government  inspectors. 

Testing  during  this  period  was  rather  archaic  from  an  operational  sense. 

No  specific  Acceptance  Quality  Level  (AQL),  as  defined  by  1HL-FTD-105 , 

were  then  employed  nor  did  any  lot  rejections  occur;  rather  the  entire 

production  line  v/ould  stop,  for  the  government  would  stop  all  deliveries 

21 

when  the  number  of  defects  became  too  large.  The  drop  tests  were 
conducted  in  a water  depth  of  only  10  feet  and  without  t:  e use  of  a 
reliable  signal  source  which  precluded  Ell  sonic  analysis.  This  testing 
would  point  out  only  the  most  obvious  malfunctions,  such  as  total  des- 
truction caused  by  water  impact  or  catastrophic  failures.  Critical 
failures  such  as  improper  operation  of  the  battery  or  hydrophone  and 

improper  acoustic  response  were  not  detected,  since  facilities  v/ere  not 

/ 

yet  available  for  tenting  these  areas. 

As  the  technology  improvements  of  tlio  sonobuoys  and  their 

associated  processors  began  to  accelerate  during  t e 1950's,  so  too  did 

the  testing  renuirenents  and  techniques.  Sonobuoy  specifications  v/ere 

revised  to  include  testing  for  quality  assurar.ee.  An  AQL  was  establish. d 

(10,0  for  major  defects,  and  15.0  for  minor  defects)  as  was  sample  size, 

22 

lot  size  and  failure  classification.  Ho  significant  changes  occured 
however,  in  the  test  facilities  or  proceedures. 

In  the  early  1960's  some  rather  broad  improvements  in  this  field 
were  made.  A major  portion  of  t e production  responsibilities  for 
sonobuoys  as  transferred  to  t'.e  Naval  Avionics  Facility,  .Indianapolis, 
Indiana  in  1959-1C60,  end  later  to  t e Naval  Ammunition  Support  Center, 
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Crane,  Indiana.  Additionally,  in  I960,  t-.e  Sonobuoy  Test  Facility, 

Pemaqt  id,  Maine  was  established,  which  greatly  expanded  the  testing 

facilities  end  caused  flight  testing  of  t.  ese  items  to  become  e dynamic 

force  in  controlling  reliability  and  production  lot  acceptance.  During 

this  period  the  AQL  was  sequentially  reduced  to  6.5  and  4.0  for  field 

23 

testing,  and  to  1.5  for  in-plant  tests. 

Because  of  the  rapid  build  up  of  sonobuoy  production  caused 
by  the  Berlin  crisis  and  later  the  Cuban  blockade,  these  field  AQL  re- 
strictions  were  temporarily  loosened  to  6.c>.  (They  are  now  back  to  4.0.)  * 
Also  during  the  1960’s  an  additional  soncbuoy  field  testing  facility  was 
established  at  St.  Croix,  in  the  Virgin  Islands,  and  additional  res- 
ponsibilities were  transferred  to  Crane.  These  responsibilities  now 
included  preproduction  and  production  support,  production  specification 
maintenance,  anc’  sonobuoy  test  facility  technical  cognizance.  Additionally, 
a research  shup  has  been  equipped  to  assist  in  testing.  The  combination 
of  the  shallow/cold  water  enviomment  of  Maine  and  the  deep/warm  water  of 
the  Virgin  Islands  are  augmented  by  the  Eobile  research  ship  for  testing 
in  actual  operating  enviomraents  such  as  the  North  and  mid-Atlantic  as 
well  as  the  Mediterranean . 

This  evolution  of  quality  assurance  testing  has  had  significant 
effects  on  the  quality  of  units  provided  to  the  fleet,  for  it  motivates 
manufacturers  to  produce  a higher  quality  product  and  it  permits  the 
Navy  to  accept  (and  pay  for)  only  those  production  quantities  that  have 
sucessfully  proven  acceptable  by  both  bench  end  field  testing,  under 
operational  conditions, 

B.  Preproduction  Testing 

Under  present  conditions,  before  a contractor  submits  any 
equipment  for  test,  detailed  testing  procedures  must  be  approved  by  Crane 
to  determine  equipment  compliance  '•  ith  requirements  and  with  specifications. 
These  tests,  which  eventually  lead  ;o  design  approval  are  considered  pre- 
production  tests  end  are  subdivided  into  contractor  demonstration  tests 
■ nd  service  approve  1 tests  (both  laboratory  and  aircraft  drop  tests). 

The  contractor  demonstration  tests  arc  p rfor  ed  under  supervision 
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of  Crone  personnel.  A total  of  50  units  are  submitted  by  the  manufacturer 
for  service  acceptance  tests  in  increments  of  10,  15,  and  25  units.  The 
initial  10  units  are  subjected  to  extensive  laboratory  testing  which  in- 
cludes enviommental  testing  (shock,  vib1  ’ion,  humidity  etc.).  The 
remaining  two  increments  are  tested  by  aircraft  drop  testing  at  the 
Maine  and/or  St.  Croix  facility.  For  service  ncceptance,  23  of  the  last 

25  units  must  sa ;isf actor! Ly  meet  all  requirements,  including  aircraft 
25 

drop  testing.  Naval  Air  Systems  Command  grants  service  approval  based 
upon  test  results  provided  by  Crane,  and  no  changes  in  either  design  or 
fabrication  can  be  made  without  government  approval.  This  has  caused  some 
rather  serious  problems  as  a result  of  the  contractors  efforts  to  remain 
fully  competitive  by  redesigning  or  modification.  While  at  times  seriously 
increasing  (end  at  times  overloading)  the  testing  laboratories  end  test 
facilities,  it  has  also  caused  a problem  to  fleet  users  in  shortages  of 
available  sonobuoys.  The  end  result  however,  is  a well  engineered, 
quality  production  item  that  fully  meets  the  users  requirements  in  v jth 
operational  capability  end  reliability.. 

C , Production  Testing. 

Following  desi  n approval,  the  contractor  commences  production, 
and  testing  of  production  lots  follow.  Tr.es e production  acceptance  tests 
are  conducted  in  the  contractors  plant  ana  at  the  government  sonobuoy 
test  facilities. 

All  in spec vo  g • nd  testing  at  the  contractors  plants  are  under 
the  direct  supervision  of  -ovtmment  inspectors  r.na  again  must  meet  or 
exceed  the  AQL  of  1.5.  Each  unit  produced  end  submitted  for  government 
acceptance  is  inspected  for  material  and  workmanship.  Further  each  unit 
is  tested  for  proper  operation,  in  a stabilized  condition,  for  compliance 
with  frequency  stability  and  sonic  performance  specifications.  Sampling 
tests  are  conducted  on  a pre-d-.  tevmined  number  of  units  per  lot.  The  u^its 
ore  randomly  selected  from  lots  t;  at  have  successfully  completed  the 
individual  inspection  and  tests.  These  sample  units  are  t'  en  s-  bjected  to 
extensive  er.v: onvxntol  mi  electronic  testin  '.  A minimum  AQL  of  1,5 
must  again  be  't. 
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The  final  testing  of  production  lot  sonobuoys  is  accomplished 
by  aircraft  dropping  of  smaller  quantities  (predetermined  by  contract 
specification)  of  production  units  that  have  successfully  passed  both  the 
contractors  individual  testing  End  sampling  tests.  The  normal  sample 
size  is  32  units  per  lot  of  800.  These  tests  sire  conducted  by  an  in- 
dependent firm,  using  government  owned  but  contractor  operated  aircraft. 

An  AQL  of  4.0  permits  successful  lot  acceptance.  Entire  lots  can  be 
reworked  by  the  contractor  and  resubmitted  for  testing,  however,  if  two 
successive  lots  are  rejected,  then  the  AQL  is  reduced  to  3.C,  until  a 
successful  test  is  obtained  when  it  is  returned  to  4.0«  Any  lot  that 

has  failed  aircraft  drop  testing  twice,  may  not  be  resubmitted  without 

26 

specific  approval  of  the  Kaval  Air  Systems  Command. 

D.  Feedback  And  Recovered  Costs. 

Because  most  failed  sonobuoys  are  immediately  recovered  end 

examined,  there  is  current  feedback  to  the  contractor  for  fault  correction. 

This  eliminates  a massive  factory  recall  or  the  permeation  of  faulty  units 

throughout  the  inventory.  Although  approximately  10,000  of  the  300,000 

sonobuoys  produced  annually  ere  air  drop  tested*  a considerable  cost  savings 

is  experienced  because  approximately  two  thirds  of  the  recovered  sonobuoys 

are  returned  to  the  respective  manufacturers  for  rework,  at  a small  fraction 

of  the  cost  of  new  units.  Thus,  although  nearly  three  percent  of  the 

units  produced  are  tested,  only  one  percent  are  totally  destroyed;  the 
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remaining  99  percent  eventually  re^ch  the  fleet  users. 

The  extensive  testing  and  stringent  acceptance  requirements 
for  both  preproduction  and  production  sonobuoys  has  significantly 
increased  the  quality  of  the  product  delivered  to  the  fleet.  Y.'hi?.e  some 
may  argue  that  the  total  testing  effort  is  too  demanding  of  resources,  it 
has  been  shown  t:  at  it  does  in  fact  guarantee  an  increase  in  the  reliability 
of  production  sonobuoys.  This  increase  in  fleet  reliability  has  occured 
despite  the  quantitative  increase  in  technical  sophistication.  And  while 
the  cost  of  sonobuoy  testing  can  be  quantitatively  determined,  the  value 
of  increased  reliabilit-  cannot.  The  lost  opportunity  of  submarine 
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detection  in  peacetime  may  result  in  only  a minor  intelligence  gap  and 
the  loss  of  training^ while  missing  the  same  opportunity  in  wartime  could 
bo  a catastrophe. 
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SECTION  7 
CONCLUSIONS 


' l hoi"  ^ 

t^Sfes^ 


Until  such  times  that  the  designers  and  engineers  produce  a 
different  method  of  finding  submarines,  either  acoustic  or  non-acoustic, 
the  aircraft,  utilizing  expendable  sonobuoys,  will  continue  as  the  main- 
stay of  the  Navy's  AS'-V  force.  And  as  technology  increases  so  v.-ill  cost; 
so  that  future  expenditures  in  this  area  of  procurement  will  continue 
to  increase. 

An  extensive  period  of  government  and  industry  cooperation  and 
education  in  this  area  has  resulted  in  a rapid  gr;  wth  in  technology  with 
an  accompanying  increase  in  operational  reliability  while  reducing  the 
relative  cost  of  each  unit.  Perhaps  the  majority  of  benefits  have  al- 
ready been  obtained,  but  continued  efforts  should  be  stressed,  particularly 
in  the  area  of  t st  end  evaluation. 

Due  to  the  relatively  short  duration  of  this  study  as  well  as  the 
nature  of  the  uncerlying  objectives  behind  it,  some  areas  of  future 
investigation  have  become  apparent.  In  some  cases  the  areas  in  question 
are  not  p -obler.s  at  all,  bu~  rather  areas  where  n.y  investigation  was 
eitner  incomplete  or  non  existant.  Others  perhaps  are  bone  fide  pr  blem 
areas  and  warrant  further  research.  No  priority  had  been  established 
to  this  listing  and  none  should  be  inferred. 

A.  Operational  Requirement. 

In  addition  to  the  performance  functions  required  of  the  various 
sonobuoys,  which  :re  normally  delineated  by  the  v?  ious  Navy  lr.bora  ories 
and  testing  facilities  involved  in  new  acoustic  processor  acquisition, 
the  most  critical  parameter  to  the  fleet  user  is  reliability.  It  s 
been  Suggested  that  sor.obuoy  r-  liability  requirements  have  been  dictated 
by  the  system  reliability  of  individual  aircraft  processors.  While  there 
is  a definite  cor' elation  between  processor  and  sor.dfcvoy  reliability, 

I contend  that  tlr  greatest  driver  of  individual  sono'ouoy  reliability 
should  bo  the  t .cUoa.l  S’-plicatio:  . The  V.cticar.s  should  specify  ex- 
actly what  relia.  ility  numbers  are  required,  ba._ed  solely  upon  oner'  tional 
necessity. 
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This  should  not  merely  be  a "wish  list"  but  based  upon  en  in  depth 
study  of  aircraft  and  system  design,  threat  parameters,  environments  and 
tactical  scenarios.  This  information  should  then  be  utilized  to  further 
investigate  cost  and  value  engineering  feasibility  studies  to  determine 
reliability  specifications. 

B.  Failure  Data. 

To  adequately  determine  reliability  requirements  it  is  mandatory 

that  accurate  and  meaningful  failure  data  be  provided  from  the  fleet  users 

to  those  managers  involved  with  planning  end  acquisition.  At  present  the 

Naval  Air  Development  Center  is  tasked  with  the  gathering  and  analysis  of 

28 

all  fleet  sonobuoy  information.  The  final  output  reliability  aid 
failure  data  is  however,  only  as  valid  as  the  fleet  input  data.  To 
a flight  crew  already  swamped  with  administrative  reporting,  the  correct- 
ness and  completeness  of  unverifiabL.  sonobuoy  failure  information  is 
currently  not  a critical  issue.  Reporting  requirements  should  be  reviewed, 
to  simplify  this  requirement  wnile  attempting  to  increase  the  accuracy  of 
the  data  gathered.  Frequent  visits  by  1TABC  personnel  to  fleet  units  and 
training  squadrons,  to  effect  education  and  to  improve  basic  communication 
should  be  encouraged;  Visits  to  fleet  stuffs  are  nice  but  staffs- don’ t 
fly.  A dialog  with  the  flight  crews  is  considered  essential. 

C . Sonob  oy  Storage  And  Handling. 

Because  the  sonoouoy  itself  j.s  a one-time-use,  expendable  item, 
its  life  cycle  is  relatively  simple.  Following  tie  final  testirg,  and  prior 
to  aircraft  launch,  tie  entire  life  cycle  consists  of  packaging,  loading, 
storage  me  handling.  The  area  of  packaging  has  been  thoroughly  invest- 
igated and  continued  improvements  are  being  made.  Likewise,  storage  h:  c 
recently  become  the  area  cf  interest.  Some  sites  have  a centralized  ware- 
house where  sonoluoys  are  stored  under  ideal  climatic  conditions  of 
constant  temperature  and  hunidi'y.  0 trier  cites  however,  have  them  stored 
in  open  hangar  decks  and  on  make  shift  c rts  which  constantly  expose  then 
to  the  elements.  Loading  ran  unloading  from  aircraft  is  perhaps  the  most 
damaging  evolution  in  r sonob  oy’e  liiv  cycle,  ai.o  this  no  t' e .rea  f at 
remains  essentially  unehrr.ged  since  ..'orld  Wrr  II  (with  the  exception  of 
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the  P-3C  and  S-3  aircraft  which  utilize  self  c ontained  storage  and 
launching  containers).  They  are  still  carried  by  hand,  up  and  down 
ladders,  across  pitching  flight  decks  and  are  permitted  to  bounce  or. 
the  back  of  flat  bed  trucks.  If  ti.<  y survive  this  ordeal,  they  are 
permitted  to  remain  on  board  these  aircraft  for  periods  in  excess  of 
their  designed  shelf  life,  in  sn  open  environment.  When  the  buoy 
subsequently  fails,  the  operator  asks  Wiy  don't  "they"  buy  sonobuoys 
that  work.  In  fact  w-;  should  ask,  why  haven't  "we"  bought  him  some 
adequate  handling  .nd  storage  devices. 

D.  I.Iobilization  3ase  Requirements, 

The  ability  to  have  available  in  sufficient  quantities,  sonobuoys 
of  the  correct  tyne,  prior  to  the  commencement  of  hostilities,  is  an 
absolute  necessity  if  the  requirement  to  find  and  destroy  submarines 
during  hostilities  is  real.  You  don' t simnly  fly  out  to  sea  and  kill 
submarines  anymore.  Rather  you  fly  to  the  general  area,  v/hioh  quite 
often  is  predicted  o previous  aircraft  search  information.  The  period 
immediately  prior  to  hositlities,  .hicli  could  consume  eutrerely  large 
quantities  of  assets,  may  in  fv-ct  be  our  only  warnin'  that  hostilities 
are  near.  The  actual  close  area  tracking  of  evasive  submarine  consumes 
far  more  sonobuoys  than  are  required  to  attack.  Additionally  the 
immediate  useege  rate  of  b oys,  durirg  any  conflict,  will  probably 
exceed  the  steady  state  due  to  the  minimum  amount  of  accurate  intelligence 
and  Quantity  of  targets.  The  numbers  of  sonoluoys  specified  as  war 
reserve  and  the  numbers  of  companies  (and  their  maximum  sustained  pro- 
duction output)  with  t.  eir  associated  stc  t up/build  up  times,  must  be 

accurately  est-  lished  ana  constantly  maintained. 

E.  Sample  Size  Ar.d  Lot  Size, 

A continuing  statistical  analysis  of  both  sample  ;nd  lot 
sizes  should  be  conducted.  In  particular  a sensitivity  snalysis  of 

Simple  size  : yd  testing  costs,  as  well  ar  s mple  size  and  fleet  relir.b  'ity, 

should  be  m.'-'iodically  conducted  to  ■ nsi.ro  optinumization  of  testi’  r 
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P,  Failure  Classification, 

The  testing  and  inspection  of  contractor  furnished  units  is 
only  as  good  as  the  testing  criteria  and  procedures  established.  Curing 
a recent  fleet  deployment,  using  normal  production  (accepted)  sonobuoys, 

I had  the  opportunity  to  participate  in  fleet  supported  aircraft  drop 
tests  with  the  research  ship  previously  described,  (under  the  direction 
of  Crane  personnel).  Two  specific  discrepancies  were  noted.  Th^  first 
was  the  standard  aircraft  altitude  for  drop  testing.  While  the  operational 
flight  profile  varies  from  200  feet  to  in  excess  of  27,000  feet,  and  an 
optimum  altitude  for  search  is  in  the  neighborhood  of  20,000  feet.  The 
test  drops,  to  similate  operational  requirements,  was  restricted  for  the 
most  part  to  less  then  5,000  feet.  Is  there  a statistical  difference  in 
failure  rates  as  a function  of  altitude?  If  not,  the  test  parameters 
are  sufficient.  If  there  is  a variance  with  altitude  then  the  -est  runs 
should  be  changed.  The  second  error  in  the  test  design  noted  was  with 
failure  recognition.  In  a significant  number  of  test  results,  it  was 
noted  that  neither  fleet  operator  nor. the  test  director,  recognized  a 
failure  as  viewed  on  the  aircraft  processor.  (These  failures  wore 
authenticated  by  the  sophisticated  equipment  aboard  the  - esearch  ship). 

Given  that  the  aircraft  equipment  was  operating  a r required,  (which  was 
later  verified),  we  must  then  be  testing  to  requirements  in  excess  of 
those  needed  for  fleet  operations.  Since  we  test  to  contract  specifications 
we  must  be  asking  for  more  than  is  required.  Reducing  specifications  and 
test  requirements  to  realistic  operational  requirements  should  case  the 
contractors  problem  of  item  acce  tar.ee,  reduce  testing  requirements 
and  cost,  and  eventually  reduce  the  overall  cost  of  sonobuoy  procurement. 
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